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1 nis invention snows now to implement a mutlipass center adaptive 
algorithm for 2 position wobulation using the same memory 
requirements as the simplified 4 position center adaptive algorithm 


Prior Solutions 


Most of the prior solutions for 2 position wobulation have been single 
pass. My recent disclosure "A Practical Implementation of Multipass 
Adaptive Wobultion" can only be extended to the 2 position algorithm 
if the standard adaptive method is used, but the standard adaptive 
algorithm does not perform well for some types of input. 


Description 


The complete description is contained in the attatched document. For 
the implementation of the multipass adaptive algorithm, one region of 
memory is required to store the previously processed subframe row. 
The novelty of this invention is storing the error values from the 
previous processed row as well. In particular the error value that is 
stored is as follows: error = errorjeft + 2*error + error_right By storing 
the error values in this fashion the error valuA<5 anH tha final 
subframe values can both be stored in an interleaved fashion in the 
same region of memory. This enables the 2 position algorithm and the 
4 position algorithm to be implemented using the same amount of 
memory. The other novelty of this invention is transforming the error 
value from a signed number containing many bits to an 8 bit number. 
A simple conversion routine is defined in the attatched document, and . 
another embodiment would be to use a look up table to do the 
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Advantages 


The primary adavantage of this algorithm is that it enables to 2 
position center adaptive wobulation algorithm to be performed using 
the same memory requirements as the 4 position algorithm. This 
invention enables one ASIC to be development that contains both 
algorithms with out any unnecessary memory. Without this invention 
the 3 pass 2 position center adaptive algorithm would require and 
additional 20% of on chip memory. 


filial 




Published 






Announced 


Disclosed 


Next Three Months 


Described 


Built 


Government Contract 


Related Disclosure 



III: 



EXHIBIT A page 3 of 14 



III 



If 
ill 



Innovation Workshop No 



: Jl : 



$?mm 






Inventors 



David C Collins - Hewlett-Packard Company Corvallis 



Witnesses 



Matthew P Heineck Hewlett-Packard Company Corvallis 



Recommended 
Classification 



Keywords 



Recommended Merlin 
Entity 



Recommended Merlin 
Loc 



Recommended Merlin 
Responsible_attorney 





Date PD Number 
Assigned 




Illfil 



: ; ; ; : : - : ,: : ,:;:;;v; -V:: : ::::: : : :; ; L 

v|; : ;;!:;;;!:^i;H!:.^;: ^grf 



EXHIBIT A page 4 of 14 



Adaptive Kernel With History - 2 Position 



Background 

The following explanation is assuming 2 position wobulation. Thus, two low resolution 
subframes must be generated for each frame - one for each wobulation position. Both of 
the subframes are processed together at the same time, and the subframes are intertwined. 
Thus, every second pixel will correspond to a different subframe. The following 
diagram illustrates the idea. The grey pixels are not used for two position wobulation. 



Top Left 
Subframe 



Bottom Right 
Subframe 




Unused subframes 
(i.e.Zero pixels) 



To compute the optimal solution, and iterative algorithm can be used. The iterative 
approach has been called the adaptive algorithm. The standard 4 position adaptive 
algorithm is described below. 

Simulation Kernel 

Mmo 

4 4 



4 4 0 

0 0 0 



Error Kernel 

oi 

0 




Origina 

I 

Image 



4 4 



Iterative Algorithm 
Simulation = K s * Subframes 
Error = Image - Simulation 
Error avg = K e * Error 
Subframes = Subframes + ax Erroravg 



In a previous disclosure, I showed how the 4 position standard adaptive algorithm could 
be implemented in one pass using a small region of interest. One of the key discoveries 
was that the pixels above the pixel of interest were only needed to generate a simulated 
image (all the subframes merge together). The following diagram illustrates the region of 
interest for one pass of the 4 position standard adaptive algorithm. 
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ROT for Error Averaeine 


























ROT for Tnitial Values 









ROT for Simulation 



Since the pixels above the pixel of interest are only required for the simulation ROI, the 
calculated values for the previous row are exactly the values that are needed. This same 
approach works for the 2 position standard adaptive method. The only change is that the 
simulation kernel has a value of l A instead of l A. This change occurs because only half of 
the high resolution pixels are non-zero. Everything else for the adaptive kernel with 
history works exactly as was disclosed before. 



Simulation Kernel 

2 2 
2 2 w 

0 0 0 



Error Kernel 
0 (fa) 

U 4 4 




Origina 
Image 



0 



4 4 



Iterative Algorithm 
Simulation = K s * Subframes 
Error = Image - Simulation 
Error aV g = K e * Error 
Subframes = Subframes + ax Error aV g 



The next algorithm that I considered for 4 position wobulation was the center adaptive 
algorithm. This algorithm performed better than the standard adaptive algorithm on 
single pixel lines. The center adaptive algorithm has several drawbacks in terms of 
implementation. First it includes many more computations than the standard adaptive 
algorithm. The second disadvantage is that both the error ROI and the simulation ROI for 
a given pixel extend above and below the pixel of interest. This implies that for the 
adaptive kernel with history. Both the final subframe values and error values from the 
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previous row are required for the algorithm. Thus more on chip memory would be 
required for an ASIC implementation. 

Simulation Kernel 

16 161 6 Hi- 
-2__4__2_ Res 

Pixel 



16 16 16 
J__2_J_ 
16 16 16 



Error Kernel 

-2_ J__2_ 

16 16 16 

J__2__L 
16 16 16 



Borde 




Iterative Algorithm 
Simulation = K s * Subframes 1 
Error = Image - Simulation 
Erroravg = K e * Error 
Subframes = Subframes + ax Error a v g 



Origina 



To overcome the implementation difficulties with the center adaptive algorithm. I 
presented a simplified center adaptive algorithm. This simplified center algorithm 
performed comparably to the .center adaptive algorithm, and it was less computationally 
expensive than even that standard adaptive algorithm The simplified algorithm is given 
below. One of the key features to note is mat the error averaging step has been 
eliminated. This is what allowed the adaptive kernel with history approach to work 
without the burden of additional memory. 

Simulation Kernel 

J__4__l_ 
8 8 8 

ofo 




Iterative Algorithm 
Simulation = K s * Subframes 
Error = Image - Simulation 
Subframes = Subframes + ax Error 



Origina 
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Unfortunately these simplifications do not give satisfying results for two position 
wobulation. This approach fails because only half of the subframe values are non-zero. 
Two of the subframes don't exist at all, and this is the same as setting all their values to 
zero. 



2 Position Center Adaptive Kernel with History 

Consider again the complete center adaptive algorithm. For 2 position wobulation, 
conceptually, half of the high resolution values are zero (two of the four subframes don't 
exist at all). Thus, the simulation kernel can be'reduced to the following two kernels. 
One kernel is used when the center hi-res pixel is non-zero, and the other kernel is used 
when the center pixel is zero. In addition, the error only needs to be averaged for the 
nonzero pixel location (the error only has to be feedback for subframes that exist). 

Simulation Kernel 



Nonzeri K§)ter 

p _L ___ j_ 
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______ _2_ 
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Zero Center 
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_2_.Q_.2_ 

8 8 
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Borde 



Iterative Algorithm 
Simulation = K s * Subframes 
Error = Image - Simulation 
Erroravg = K e * Error 
Subframes = Subframes + a x Error aV g 



Thus, the computational complexity is only half of the complete 4 position center 
adaptive algorithm. The obstacle of the error from the previous row still remains. The 
solution is to store both the final subframe values and the error values in one row of 
image memory. For a given high resolution row, only half of the locations are used to 
store subframe values. The other half of the values are unused or set to zero. This leaves 
half of the values for storing the errors. 

The second observation is that for a given row in the hi-res image, only half of the values 
require the error to be averaged. The following diagram is an attempt to illustrate this 
point. 
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Previous row of 
subframe values 



Previous subframe 
errors 



Current row of 
interest 



Future rows 




Unused subframes 



The pink error values actual contains a summation of the error value of the left and right 
pixels in addition to its own error value. In particular, each error value adheres to the 
following formula: 

Error = 1 *error i e ft _pi xe i + 2*eiror + 1 *error rig ht jrixei 

This matches the first row of the error averaging kernel. Thus, in one row of memory we 
can store both the required error values and the subframe values, the last little detail is 
that the error value is a signed value, and it contains more bits than a single pixel. To 
accommodate this we can use a lookup table or a simple mapping. Psuedo code for one 
such simple mapping is as follows: 



temp = error_left+2*error+error_right; 


// 


lx 2x lx 


temp = temp/ 4; 


// 


divide by 4 


if ( temp < -127 ) temp = -127; 


// 


clip value 


if ( temp > 127 ) temp = 127; 


// 


clip value 


temp += 127; 


// 


shift to make non-zero 



Thus, the key features to implement the 2 position center adaptive algorithm using the 
adaptive kernel with history is that both the final subframe values and the previous error 
values can be stored in one row of image memory. Thus, a 3 pass 2 position center 
adaptive algorithm can still be implemented with 1 row of history and 4 rows of image 
data. 
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Appendix 

For completeness I have include some C++ code for calculating the center adaptive kernel with history. One 
thing to note is that I need to keep track of whether I am on an odd or an even pixel because I have to keep track 
of which subframe values are unused. 

unsigned char AdaptiveCenterKernel_2Pos :: Calculate 
( unsigned char finalO, 

unsigned char image 1, 

unsigned char image2, 

unsigned char image 3, 

unsigned char image4, 

unsigned char isOddPixel 

) 
{ 

int temp; 

// isOddPixel = true 

// 0 fO_l 0 f0_3 0 f0_5 
// glj) 0 gl_2 0 gl___4 . 0 
// 0 g2_l 0 g2_3 0 g2_5 
// g3__0 0 g3_2 0 g3_4 0 
// 0 g4_l 0 g4_3 0 g4_5 



// isOddPixel « false 



// 


fO 0 


0 


fO 2 


0 


fO 4 


0 


// 


0 


gi i 


0 


gl 3 


0 


gl 5 


// 


g2 0 


0 


g2 2 


0 


g2 4 


0 


// 


0 


g3 1 


0 


g3 3 


0 


g3 5 


// 


g4 0 


0 


g4 2 


0 


g4 4 


0 



shiftValuesO; 



finalO_5M = finalO; 
imagel_5M = imagel; 
image2_5M = image2; 
image3_5M « image3; 
image4_5M « image4; 

// calculate guess for column 4 

// using pixel selection - no calculations here 

guessl_4M = imagel_4M; 

guess2_4M = image2_4M; 

guess3_4M = image3_4M; 

guess 4_4M = image 4_4M; 

// compute sim column 4 
int siml_4 = 0; 
int sim2_4 = 0; 
int sim3_4 = 0; 
int sim4_4 = 0; 

if ( isOddPixel ) 
{ 

siml_4 o final0_3M+guess2_3M+fina!0_5M+image2_5M; 
siml_4 += guessl_4M«2; // multiply by four 

sim2_4 = (guessl_4M«l) + (guess2_3M«l) + ( image 2_5M«1) + (guess3_4M«l) ; 

sim3_4 = guess2_3M+guess4_3M+image2_5M+image4_5M; 
sim3_4 += guess3_4M«2; // multiply by four 
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//sim4_4 = (gu3Ss3_4M«l) + <guess4_3M«l) + (guess4_5M«l) + (guess5_4M«l) ; invalid 
sim4_4 = (gues£3_4M«l) + (guess4_3M«l) + { image 4_5M«1) + (guess4_4M«l) ; 

else 
{ 

siml_4 = (finalO_4M«l) + (guessl_3M«l) + (imagel_5M«l) + (guess2_4M«l) ; 

sim2_4 = guesslJ3M+guess3_3M+imagel_5M+image3_5M; 
sim2_4 += guess2_4M«2; // multiply by four 

sim3_4 = (guess2_4M«l) + (guess3_3M«l) + (image 3_5M«1) + (guess4_4M«l) ; 

// sim4_4 m guess3_3M+guess5_3M+guess3_5M+guess5_5M; invalid 
sim4_4 - guess3_3M+guess4_3M+image3_5M+image4_5M; 
sim4_4 +- guess4_4M«2; // multiply by four 



int errl_4 = (imagel_4M«3) - siml_4; // column 4 

int err2_4 = (image2_4M«3) - sim2_4; 

int err3_4 « (image3_4M«3) - sim3_4; 

int err4_4 = (image4_4M«3) - sim4_4; 

// compute sirn column 3 
int siml_3 =0; // column 3 
int sim2_3 = 0; 
int sim3_3 - 0; 
int sim4_3 - 0; 

if( iisOddPixel ) 
{ 

siml_3 = final0_2M+guess2_2M+final0_4M+guess2_4M; 
siml_3 +- guessl_3M«2; // multiply by four 

sim2_3 = (guessl_3M«l) + (guess2_2M«l) + (guess2_4M«l) + (guess3_3M«l) ; 

sim3_3 = guess2_2M+guess4_2M+guess2_4M+guess4_4M; 
sim3_3 += guess3_3M«2; // multiply by four 

sim4_3 = (guess3_3M«l) + (guess4_2M«l) + (guess4_4M«l) + (guess4_3M«l) / 

else 
{ 

siml_3 = (f inalO_3M«l) + (guessl_2M«l) + (guessl_4M«l) + (guess2_3M«l) ; 

sim2_3 - guessl_2M+guess3_2M+guessl_4M+guess3_4M; 
sim2_3 += guess2_3M«2; // multiply by four 

sim3_3 « (guess2_3M«l) + (guess3_2M«l) + (guess3_4M«l) + (guess4_3M«l) ; 

// sim4_3 • guess3_2M+guess5_2M+guess3_4M+guess5_4M; invalid 
sim4_3 - guess3_2M+guess4_2M+guess3_4M+guess4_4M; 
sim4_3 +« guess 4_3M«2; // multiply by four 



int errl_3 = (imagel_3M«3) - siml_3; // column 3 

int err2_3 = (image2_3M«3) - sim2_3; 

int err3_3 = (image3_3M«3) - sim3_3; 

int err4_3 = (image4_3M«3) - sim4_3; 

int siml^2 - 0; // column 2 
int sim2_2 = 0; 
int sim3_2 = 0; 
int sim4_2 = 0; 
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if ( isOddPixel ) 
{ 

siml_2 - finalO_lM+guess2_lM+finalO__3M+guess2_3M; 
siml_2 += guessl_2M«2; // multiply by four 

sim2_2 = (guessl_2M«l) + (guess2_lM«l) + (guess2_3M«l) + (guess3_2M«l) ; 

sim3_2 = guess2_lM+guess4_lM+guess2_3M+guess4_3M; 
sim3_2 += guess3_2M«2; // multiply by four 

//sim4_2 « (guess3_2M«l) + (guess4_lM«l) + (guess4_3M«l) + (guess5_2M«l) ; invalid 
sim4_2 - (guess3_2M«l) + (guess4_lM«l) + (guess4_3M«l) + (guess4_2M«l) ; 



} 

else 
{ 



} 



siml_2 - (finalO_2M«l) + (guessl - lM«l) + (guessl_3M«l) + (guess2_2M«l) ; 

sim2_2 = guessl_lM+guess3_lM+guessl^3M+guess3_3M; 
sim2_2 += guess2_2M«2; // multiply by four 

sim3_2 = (guess2_2M«l) + (guess3_lM«l) + (guess3_3M«l) + (guess4_2M«l) ; 

// sim4_2 m guess3jLM+guess5_lM+guess3_3M+guess5_3M; invalid 
sim4_2 = guess3_lM+guess4_lM+guess3_3M+guess4_3M; 
sim4_2 +- guess4__2M«2; // multiply by four 



int errl_2 = (imagel_2M«3) - siml_2; // column 2 

int err2_2 - (image2_2M«3) - sim2_2; 

int err3_2. = (image3_2M«3) - sim3_2; 

int err4_2 » (image4_2M«3) - sim4_2; 

// compute guess column 3 

if{ isOddPixel ) 

{ 

temp = (errl_2»2) + (errl_3»l) + (errl_4»2); // 2x 4x 2x 

temp += (err2_2»l) + err2_3 + (err2_4»l); // 4x 8x 4x 

temp += (err3_2»2) + (err3_3»l) + (err3_4»2); // 2x 4x 2x 

temp = temp * alphalM; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guess2_3M; 

guess2_3M - max (0,min (temp, 255) ) ; 7/ clip value 



} 

else 
( 



// err4_3 - don't update this value - we don't realy have enough information 
III will need to check if an aproximation is better than nothing though 



//temp - (err0_2»2) + (errOJ3»l) + (err0_4»2); // 2x 4x 2x 
temp - (finalO_3M-127)«3; // 2x 4x 2x 

temp += (errl_2»l) + errl_3 + (errl_4»l) ; // 4x 8x 4x 
temp +« (err2_2»2) + (err2_3»l) + (err2_4»2); // 2x 4x 2x 

temp = temp * alphalM; 

temp « temp » 7; // numerator is assumed to be 4 

temp « temp + guess 1_3M; 

guessl_3M = max (0,min (temp, 255) ) ; // clip value 

temp = (err2_2»2) + (err2J3»l) + (err2_4»2) ; // 2x 4x 2x 
temp += (err3_2»l) + err3_3 + (err3_4»l) ; // 4x 8x 4x 
temp +« (err4_2»2) + (err4_3»l) + (err4_4»2) ; // 2x 4x 2x 
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temp - temp * alphalM; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guess3_3M; 

guess3J3M = max (0,min {temp, 255) ) ; // clip value 

} 

// compute sim column 1 
int siml_l = 0; // column 1 
int sim2_l » 0; 
int sim3_l = 0/ 
int sim4_l = 0; 

if( ! isOddPixel ) 
{ 

siml_l = final0_0M+guess2_0M+final0_2M+guess2_2M; 
siml_l += guessl_lM«2; // multiply by four 

sim2_l = (guessl_lM«l) + (guess2_0M«l) + (guess2_2M«l) + (guess3_lM«l) / 

sim3_l « guess2_0M+guess4_0M+guess2_2M+guess4_2M; 
sim3_l guess3_lM«2; // multiply by four 

sim4_l = (guess3_lM«l) + (guess4__0M«l) + (guess4_2M«l) + {guess4_lM«l) ; 

else 
{ 

siml__l - (finalO__lM«l) + (guessl_OM«l) + (guessl_2M«l) + (guess2_lM«l) ; 

sim2_l = guessl_0M+guess3_0M+guessl_2M+guess3_2M; 
sim2_l += guess2_lM«2; // multiply by four 

sim3_l = (guess2_lM«l) + (guess3_0M«l) + (guess3_2M«l) + (guess4_lM«l) ; 

sim4_l = guess3_0M+guess4_0M+guess3_2M+guess4_2M; 
sim4_l += guess4_lM«2; // multiply by four 

} 

int errlJL - (imagel_lM«3) - siml_l; // column 1 
int err2_l = (image2_lM«3) - sim2_JL; 
int err3_l = (image3_lM«3) - sim3_l; 
int err4_l = (image4_lM«3) - sim4_l; x 

// Compute Guess for Column 2 

if( lisOddPixel ) 

{ 

temp » (errl_l»2) + (errl_2»l) + (errl_3»2) ; // 2x 4x 2x 

temp += (err2_l»l) + err2_2 + (err2_3»l) ; // 4x 8x 4x 

temp += (err3_l»2) + (err3_2»l) + (err3_3»2) ; // 2x 4x 2x 

temp = temp * alpha2M; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guess2_2M; 

guess2_2M = max (0,min (temp, 255) ) ; // clip value 

// err4_3 - don't update this value - we don't realy have enough information 
111 will need to check if an aproximation is better than nothing though 

else 
{ 

// temp - <err0_l»2) + (err0_2»l) + (err0_3»2) ; // 2x 4x 2x 
temp = <finalO_2M-127)«3; // 2x 4x 2x 

temp += (errl_l»l) + errl_2 + (errl_3»l) ; // 4x 8x 4x 
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) 



temp += (err2_l»2) + (err2_2»l) + (err2_3»2) ; // 2x 4x 2x 
temp « temp * alpha2M; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guessl_2M; 

guessl_2M = max (0,min (temp, 255) ) ; // clip value 

temp = (err2_l»2) + (err2_2»l) + (err2_3»2) ; // 2x 4x 2x 
temp += (err3_l»l) + err3_2 + (err3_3»l) ; // 4x 8x 4x 
temp += (err4_l»2) + (err4_2»l) + (err4_3»2) ; // 2x 4x 2x 

temp - temp * alpha2M; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guess3_2M; 

guess3_2M = max (0,min7temp, 255) ) ; // clip value 



// Compute Guess for Column 1 

if( isOddPixel ) 

{ 

temp - (errl_0M»2) + (errl_l»l) + (errl_2»2) ; //*2x 4x 2x 

temp += (err2_0M»l) + err2_l + (err2_2»l) ; // 4x 8x 4x 

temp.+= (err3_0M»2) + (err3_l»l) + (err3_2»2) ; // 2x 4x 2x 

temp ■» temp * alpha3M; 

temp = temp » 7; // numerator is assumed to be 4 

temp = temp + guess 2_1M; 

guess2_lM - max (0,min (temp, 255) ) ; // clip value 

// err4JL = don't update this value - we don't realy have enough information 
//I will need to check if an aproximation is better than nothing though 

else 
{ 

//temp - (err0_0M>>2) + (errOJL»l) + (err0_2»2); // 2x 4x 2x 
temp - (finalO_lM-127)«3; // 2x 4x 2x 

temp +« (errl_0M»l) + errl_l + (errl_2»l) ; // 4x 8x 4x 

temp +~ (err2_0M»2) + (err2_l»l) + (err2_2»2); // 2x 4x 2x 

temp = temp * alpha3M; 

temp = temp » 7; - // numerator is assumed to be 4 

temp = temp + guess 1_1M;- 

guessl_lM = max (0,min (temp, 255) ) ; // clip value 

temp = (err2_0M»2) + (err2_l»l) + (err2_2»2) ; // 2x 4x 2x 
temp += (err3_0M»l) + err3_l + (err3_2»l) ; // 4x 8x 4x 
temp +== (err4_0M»2) + (err4JL»l) + (err4_2»2) ; // 2x 4x 2x 

temp = temp * alpha3M; 

temp » temp » 7; // numerator is assumed to be 4 

temp ■» temp + guess 3_ 1M; 

guess3_lM = max (0,min (temp, 255) ) ; // clip value 

} 

unsigned char rv = 0; 

if( isOddPixel ) 
{ 

rv = guessl_0M; 

) 

else 
{ 

temp = (old_errl_0M»3) + (errl_0M»2) + (errl_l»3);//lx 2x Ix 
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temp = temp» 2; // divide by 4 

// make the signed value fit in one byte! 

// I could do a non-linear lookup table here! 

if ( temp < -127 ) temp = -127; 

if ( temp > 127 ) temp = 127; 

temp += 127; 

rv = (unsigned char) temp; 

} 

// Shift Error Values 
old_errl_0M = errl_0M; 
errl_0M = errl_l; 
err2_0M = err2_l; 
err3_0M = err3_l; 
err4_0M - err4_l; 

return rv; //return error value or subframe value 



/ 



